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Abstract. We investigate feasible computation over a fairly general no- 
tion of data and codata. Specifically, we present a direct Bellantoni-Cook- 
style normal/safe typed programming formalism, RSi, that expresses 
feasible structural recursions and corecursions over data and codata spec- 
ified by polynomial functors. (Lists, streams, finite trees, infinite trees, 
etc. are all directly definable.) A novel aspect of RSi is that it embraces 
structure-sharing as in standard functional-programming implementa- 
tions. As our data representations use sharing, our implementation of 
structural recursions are memoized to avoid the possibly exponentially- 
many repeated subcomputations a naive implementation might perform. 
We introduce notions of size for representations of data (accounting for 
sharing) and codata (using ideas from type-2 computational complexity) 
and establish that type-level 1 TJS'j -functions have polynomial-bounded 
runtimes and satisfy a polynomial-time completeness condition. Also, 
restricting RSi terms to particular types produces characterizations of 
some standard complexity classes (e.g., tj-regular languages, linear-space 
functions) and some less-standard classes (e.g., log-space streams). 



1 Introduction 

What counts as polynomial-time (much less "feasible") computation over gen- 
eral forms of data is not a settled matter. The complexity-theoretic literature 
of higher-type computability is still thin, it is spotty on computation over co- 
data (infinite lists and trees) with some notable exceptions|f| and even in the 
case of inductively defined data there are there remain issues that are not that 
well explored (see the end of §2 below). We develop a notion of polynomial-time 
computation over data and codata using a fairly simple implicit complexity for- 
malism, RSi , that satisfies poly-time soundness and completeness properties. 
RSi is constructed in stages. We first introduce , a formalism for computing 
over inductively defined data by classical structural (aka primitive) recursion. S~ 
has roughly the computational power of Godel's primitive recursive functionals 



^ Hartmanis and Stearns' paper PTj that founded computational complexity largely 
focuses on the time-complexity of infinite streams as the authors directly adapted 
Turing's original machine model [20] which, recall, concerns stream-computation. 
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[15] ■ To tame this power, we impose a form of Bellantoni and Cook normal/safe 
ramification on S'"'s structural recursions and obtain RS^ , a system that sat- 
isfies appropriate poly-time soundness and completeness properties. We next 
introduce S, an extension of S~ to include codata definitions and classical struc- 
tural (aka primitive) corecursions. We extend the safe/normal ramification to 
corecursions and obtain RSi that also satisfies poly-time soundness and com- 
pleteness properties. The subscript on RS^ and RS2 is a reminder that these 
formalisms focus on type-level 1 computation, eventhough RS^ and RSj al- 
low higher-type terms. It turns out that by restricting types in RS i-tevms, one 
can characterize other complexity classes, e.g., w-regular languages, log-space 
streams of characters, linear-space streams of strings, etc. These seem to be re- 
lated to the two-sorted complexity class characterizations studied by Cook and 
Nguyen [6]. 

Related Work. The Pola project of Burrell, Cockett, and Redmond |4I5| has 
aims similar to ours, but Pola forbids any structure-sharing of safe-data or safe- 
codata. RS^ and RSi , in contrast, embrace structure-sharing and adjust the 
implementation of structural recursions to accomodate it. As a result RS2 and 
Pola describe different notions of polynomial-time over data and codata. How 
deep these differences go is an intriguing question. Pola also has a well-developed 
categorical semantics that, at present, RSi notably lacks. Ramyaa and Leivant 
|17)18] explore feasible first-order stream programming formalisms. In |17j, they 
use infinite binary trees with string-labels to give a partial proof-theoretic char- 
acterization of the type-2 basic feasible functionals (BFF2) of Mehlhorn [16] and 
Cook and Urquhart [7| . In |18| , they give a definition of logspace stream compu- 
tation and a schema of ramified co-recurrence which parallels Leivant's ramified 
recurrence of [1^, and characterize logspace streams as those definable using 
2-tier co-recurrences. Feree et al. [101 also consider stream computation, but pri- 
marily as a technical tool in characterizing BFF2 as the functions computed by a 
rewrite system over streams that has a second-order polynomial interpretation. 

Background. Pointer Machines. We assume that the underlying model of 
computation is along the lines of Kolmogorov and Uspenskii's "pointer machines" 
or Schonhage's storage modification machines [21^ . 

Types. The simple types over a set of base types B are given by: Ty^ ::= B \ 
unit I Ty^+Ty^ \ Ty^ x Ty^ \ Ty^ Ty^ , where unit (which counts as a base 
type) is the type of the empty product (). Let level{a base type) = 0, level{a + T) 
= level{aXT) — iB.ax{level{a) , level{T)), levelijr t) = max.{l + level{a), levelir)), 
and Tyf = { (t G Ty^ \ level{a) < i }. We call level-0 types ground types. A type 
judgment F h e: cr asserts that e can be assigned type a under type context 
where a type context is a finite function from variables to types. 

Algebraic Notions. Set denotes the category of sets and total functions. Below 
we are mainly concerned with total functions and lower type-levels, so Set suffices 
as the setting for the semantics of our programming formalisms. Types are thus 
interpreted as sets where coproduct (-(-), product (x), and exponentiation (— >) 
have their standard iSef-interpretations. Let i^i. Ai Ai + A2 {i = 1,2) be 
the canonical coproduct injections and "ncAi y. A2 Ai {i — 1,2) be the 
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canonical product projections. A polynomial functor is a functor inductively 
built from identity and functors and coproducts and products, e.g., Fq X = 
unit + (nat x X) with Fq f = idunit + (idnat x f), where nat is the type 
of natural numbers introduced below in Example [Til The constant-objects in 
our polynomial functors will always be types. Convention: For F, a polynomial 
function given hy F X — e, and a, a type, read Fa as the type e[X : ~ a]. E.g., 
Fq nat = unit + nat x nat. 

The Base Formalism. This paper's programming formalism are built atop L, 
a standard, simply- typed, call- by- value lambda calculus. The L-types are T?/®. 
Figs. lA.l1 and lA.2] give L's syntax and typing rules. We use the standard syntactic 
sugar: (i) \etxi = ei;...;Xm = emineo = (Axi, . . . , .eo) ei ... and 
(a) \eUxi = ei; . . . ;xm = e„i in eo = \etxi = ei in(. . . (letx^ = e„i in eo) . . . ). 

Semantics. The denotational semantics of L is standard. As unit is the sole 
base type of Ty®, for each a e Tyf, {aj is a finite set. L's operational seman- 
tics is also fairly standard as specified by the evaluation relation, J,, described 
in Fig. IA.31 Terminology: An evaluation relation relates closures to values. A 
closure [F h e: T)d consists of a term F h e:T and an environment 9 for F h e:T. 
(We write e6 for {F h e: t)0 when e's typing is understood.) An environment 9 for 
F \- e: T is a. finite map from variables to values with fv(e) C dom(6') C dom{F) 
and, for each x G dom(0), 9{x) is a type-r'(x) value. A value z9 is a closure 
in which z (the value term) is either an abstraction or else an internal repre- 
sentation of or iiVi or (wi,W2), where vi and V2 are value terms. By internal 
representation we mean the "machine" representation of value terms, the details 
of which are not important for L, but vital for the RS~ and RS formalisms 
below. 

2 Structural Recursions 

The Classical Case. We extend L to 5*^, a formalism that computes, roughly, 
Godel's primitive recursive functionals |15j over inductively-defined data types. 
Later we introduce RSJ , a ramified, "feasible" version of S~ . Fig. [1] gives the 
revised raw syntax ([T]), typing rules {cr-I, dr-I, foid^r--^) and evaluation rules 
{Constr, DestrT, Foldr) for . A declaration, data r fit. a, introduces a data- 
type T. The polynomial functor F^t = cr is called r's signature functor. The 
declaration also implicitly introduces: r's constructor function Ct-: Ft-t — >■ t, r's 
destructor function dr'. t — F^-t, and r's recursor foldr: (V(T)[(ivo' — S> o") — S> r ^ 
a]. We require that the a in datar = fit. a be a ground type with constituent 
base types are drawn from t, unit, and previously declared types. Semantically, 
the data type r is the lea.st fixed point of Fj- : it is a smallest set X isomorphic to 
Ft-{X), where Cr and d-r witness this isomorphism. It is standard that polynomial 
functors have such least fixed points. In examples we use syntactically-sugared 
versions of datar = fit. a of the form: datar = Ci of cri [ ... [ C„ of (t„, where 
Fr{T) = (Ti + (72 + ■ ■ • + and, for each j, if ai — unit, then Ci = Cr o if () : r 



* Other authors (e.g., [19]) use broader notions of polynomial functor. 
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Del ■■- dataT = ^T' .Tyg P :■- declare Del (; Del)* in E (1) 

r\-e:Fr Dhe-.T F h f: Fa ^ a F h e: r 

Ct-I: ; ^ — cIt-I: -, ^ foldr-/.' 

F\-(cre):T F\-{d^e):FT T h fold^ / e: cr 

e9 i v6' ed i (c^ v)6' 

ConsU: -, : ; r-r Destr-r: ^ 7 

{ere)e i{c^v)e' {dre)eive' 

eei{c^v)ei fiFiXx.iio\d,fx))y)e[y^ve^]iv'e' 

toldr: -, ^ 1—, (x and y are tresii) 

(fold^/e)^!^'^' ^ ' 



Fig. 1. Extensions for S , wliere r is is a data-type witli signature functor F. 



and if ct^ / unit, then Ci=CrO t" : Oi Type-r data can then be identified 

with the elements of the free algebra over the sugared constructors Ci , . . . , C„ 
and the other constituent data-types' constructors. 

Example L The declaration, data nat ~ Zero of unit [ Succofnat, introduces 
the type nat with signature functor F^atX ~ unit + X and sugared constructors 
Zero: nat and Succ: nat nat. Type-nat data thus corresponds to the terms 
of the free algebra over Zero and Succ, i.e.. Zero, Succ(Zero), Succ(Succ(Zero)), 
etc. 

Example 2. The declaration, data tree — Leaf of unit [ Fork of tree x tree, in- 
troduces the type tree with signature functor Ftree-'^ = unit + X x X and 
sugared constructors Leaf: tree and Fork: tree x tree tree. Type-tree data 
thus corresponds to the terms of the free algebra over Leaf and Fork, i.e., Leaf, 
Fork(Leaf, Leaf), Fork(Fork(Leaf, Leaf), Leaf), etc. 

The recursor for type-r data, foldr, has its operational semantics given by 
Fig. [TJs Foldr rule@ and satisfies: {^o\Ar g) o Cr = <? o F(fold^g). This last equa- 
tion expresses structural (aka primitive) recursion over r. For example, given an 
/^-Ftreenat — >■ nat with /(ti()) = Zero and f{L2{x,y)) ~ Succ(max(a;, y)), then 
(foldtree ft) computcs the height of tree t. As the g in (fold^ gx) can be of any 
positive type level, one can show that computes a version of Godel's primi- 
tive recursive functionals. To rein in the power of fold-recursions to express just 
low complexity computations, we apply a standard tool of implicit complexity, 
ramification. First, however, we need to consider how data is represented and 
how the size of a representation is measured. 

Representation, Size, and Memoization. Representing Data. Our internal 
representation of data follows standard practice in implementations of functional 
languages. Each invocation of a constructor function: (i) allocates a fresh cons- 
cell that stores the values of the invocation's arguments and (ii) returns, as its 

^ For 1 < i < n, define: l" — iio tj*"^^ and — Also, define: l\ = id. 

® In the rule Foldr, the use of F should be read as shorthand for a A-term that 
expresses, in S~ , the polynomial function F (specialized to the appropriate types). 
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value, a pointer to this new cons-cell. N.B. The product and coproduct con- 
structors also create cons-cells. As our formalism is purely functional, it follows 
that all data is represented by directed acyclic graphs (dags) on cons-cells. 

Measuring The Size of Data Representations. A data-representation's size is 
simply the number of data cons-cells in the representation. For example, consider: 

let* to = Leaf; ti = Fork(to,to); . . . ; i„ = Fork(t„_i, t„_i) in t„ (2) 

The size of i„'s representation is n -I- 1 (one Leaf-cell and n Fork-cells). This 
notion of size depends on the operational semantics. Denotationally, t„ names a 
proper tree which is also named by tj^, a sized- (2"+^ — 1) tree consisting of 2" 



Definition 3. Suppose cqO, . . . , ekO are ground-type closures. The apparent size 
of { CqO, . . . , ekO } (written: |eo, . . . , e^jflj is the number of data cons-cells in the 
representation the values of e^O, . . . ,ekd . (N.B. This takes account of sharing. 
E.g., if 9 is the environment in force in the body of ([2]), then jig, • ■ • , tn| = n+1.) 

Memoized Structural Recursions. Two of our goals for our feasible program- 
ming formalisms are: (i) io have the run-time of programs to be polynomial- 
bounded in the size of the representations they compute over; and (ii) to have 
our programs to return equivalent results on equivalent inputs (e.g., t„ and t'^ 
as above). These goals would seem to conflict given our conventions on data-re- 
presentions and sizes. This is resolved via the standard programming trick of 
memoization [P. Computing (foldr fx) can be treated as a linear programming 
problem with x's data representation as the underlying dag, there is, then, an 
exact match between the fold-recursion's steps and x's cons-cells, moreover, the 
result of each step is stored for possible reuse later in the recursion. We assume 
that our structural-recursion implementation uses memoization for just branch- 
ing data types (e.g., tree); for nonbranching data-types (e.g., nat) it is not 
needed. 

The Ramified Case. RSf , our ramification of 5^, uses Bellantoni and Cook's 
normal/safe distinction that splits data into two sorts: normal data that drive 
recursions and safe data over which recursions compute. E.g., in (foldr gcc) we 
want X normal and 5: (safe data) — >■ (safe data). Typing constraints enforce this 
distinction, which is roughly the idea behind Bellantoni and Cook's BC func- 
tion algebra [Sj §5] (and Leivant's formalism from [E]), but not Bellantoni and 
Cook's better known B function algebra. Normal types: The normal base types 
consist of unit and the types directly introduced by data-definitions. The nor- 
mal ground types are the closure of the normal base types under + and x . In 
datar ~ /it.cr, we require that cr be normal. A declaration data r = fit.a intro- 

c 

duces Ct and dr as before, but foldr is replaced with fold^ as explained shortly. 
Safe types: By convention, data t = fit.a implicitly introduces a parallel type r^. 
We extend to all normal ground types by: unit^ — unit, (cti x 0-2)^ — af x erf j 

For simplicity, we do not count the cons-cells of product and coproduct constructors 
in representations as the asymptotics are the same whether we count these or not. 




6 Banner and Royer: Ramified Structural Recursion and Corecursion 



' , , ,.s , (t) lower: — (J) 

r h fold^ / e: (7 r \- e-.T 



Fig. 2. Key additions for RS . (f) r is a normal and a is safe. (J) sfv(e) 



(o"i + <J2)^ = af + (Tj . (Note: unit is the sole normal and safe base type.) has 
constructor c^: {Ftt)^ — > and destructor df-.r^ — s> {Ftt)^. In examples, we use 
sugared constructors for t^, e.g., Succ^: nat^ nat^. The elements of are es- 
sentially "safe" copies of the elements of r. Let sfv{r ^ e-.r) — {x & fv(e) 1 r{x) 
is safe}, which we write as sfv(e) when the judgment is understood. 

The new recursor for r-data, fold^, has the same operational semantics as 
fold,- (Fig. [TJ Foldr) and the same typing rule as foldr except for the new 
side-condition, see Fig. [2l Examples: up^ — Ax. (fold^ x) : r — > translates 
each type-r datum to the corresponding type-r^ datum; plus = Xx,y.{\etg = 
Az. casezof (tiw) ^ y; (^2^) (Succ^ w) in (fold^j^^^ ^x): nat — > nat^ — s> nat^ 
adds its arguments and times — Ax, y. (let /i = Xz. case z of (tiw) (Succ^ Zero); 
{i2'w) (plusxw) in (fold^^^ hy):nat nat — nat^ multiplies its arguments. 

Ramified type systems have a perennial difficulty: certain natural composi- 
tions can be untypable, e.g., cube — Ax . times x (times x x) fails to type using the 
rules stated so-far. As a mitigation, we introduce the lower typing rule (Fig. [T]) 
which is an adaptation to A-calculi of Bellantoni and Cook's Raising Rule [3]. 
Using lower on the {times x x) subterm yields a nat — ^ nat^ version of cube and 
an second application of lower yields a nat nat version. When we say a type-1 
function is -RS'^-computable, we usually mean it is computed by a type-(CT r) 
iiS'j'-term where both a and r are normal. 

RSJ is thus the modification of S~ as sketched above with one last change: 
+-/ and X-/ now have the side-condition that the component types, ai and (72, 
are both either normal ground types or safe ground types. (Thus each ground- 
type RSJ -term is of either of normal- or safe-type. This simplifies size bounds.) 

Poly-Heap Size Bounds. Bellantoni and Cook proved poly-max size bounds 
for their formalisms, e.g., if e is a base-type (string- valued) i?C-expression, then, 
for all 0, \e9\ < {p + maiXy^sfvie) l?/|)^j where p is a normal polynomial, i.e., p is is 
polynomial over { |x| 1 x e fv(e) & x has a normal type }. Because of sharing we 
replace poly-max with poly-heap bounds, i.e., those of the form p + . . . , y„| 
(recall Definition [3]) where p is a normal polynomial and { ...,?/„ } — sfv(e). 
(Convention: We write bounds as |e| < p -\- . . . , y„|, keeping the universal 
quantification over implicit and in place of \yi, . . . , y„| we write |sfv(e)|. 

Theorem 4 (RSJ Poly- Heap Size-Boundness). Given an RSJ judgment 
F \- e:T in which t and each a S image(-r) is a ground type, one can effectively 
find a normal polynomial p with \e\ < p -\- |sfv(e)|. 

A partial proof of Theorem |4] is given in the Technical Appendex. RSf also 
satisfies poly-cost boundness (the computation tree oi F \- e:T has a poly-size 
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bound over { I x £ dom(_r) }) and poly- completeness (for a suitable model 
of computation and cost, RS^ can compute all poly-time computable type-1 
functions). For want of space we omit these results, but their proofs are similar to 
analogous results in (8i9j . N.B. While the completeness result's proof is standard, 
the result itself is a little subtitle. Typically, complexity classes concern the purely 
representational level and not extensionality constraints imposed by the things 
represented. In contrast, the -computable (tree — >■ tree)-functions form a 
nonstandard complexity class: all the poly-time (in the dag-size) computable 
functions over tree-representations which functions are extensional with respect 
to tree-data. Type Restricted RS^ ■ Let i?5'7[nat] be the restriction of RS^ 
to terms with types in Ty^ "at.nat^ } follows from piTi] that the RS^ [nat]- 
computable (nat x ■ • • x nat nat)-functions = £2, the second Grzegorczyk 
class (aka, the linear-space computable functions). £2 plays a key role in "two- 
sorted complexity" characterizations [6l Chapter 4]. We shall make similar use 
of it below. 

3 Structural Corecursions 

The Classical Case. We extend S~ to S, a formalism that computes, roughly, 
Godel's primitive recursive functionals over inductively- and coinductively-defined 
data. RSi will be our ramified, "feasible" version of S. Fig. Ogives the revised 
syntax ([3]) and evaluation rules (Destr'^, Unfold^). The typing rules for c,-, d^., 
and unfold^ are given implicitly below. A declaration, codatar = i/t.a, intro- 
duces a codata-type t. The polynomial functor Frt = ct is called t's signa- 
ture functor. The declaration also implicitly introduces: r's constructor func- 
tion Ct'. FrT — r, r's destructor function dr'.T — > FtT, and r's corecursor 
unfoldr: (V(t)[((T — > Fa) — > r]. The a in codatar = vt.a must be a 

ground type with constituent base types drawn from t, unit, and previously 
declared types. Type-r's corecursor, unfold,-, has its operational semantics given 
by Fig. [3ls Unfoldr-ruie and satisfies: d^ o (unfold^ /) = ^^(unfold^ /) o /. N.B. 
Codata constructors and unfolds are lazy: c^- and unfold^-expression are values 
and hence are not evaluated unless forced by a d^-application per Destr'^ and 
Unfold^. Semantically, a codata type r is the greatest fixed point of F^: it is a 
largest set X isomorphic to Fr{X), where dr and cv witness the isomorphism. 
Polynomial iSei-functors are know to have such greatest fixed points [191 Theo- 
rem 10.1]. In examples, we use sugared codata-declarations along the lines of the 
sugared data-declarations. 

Example 5. The declaration, codata nats = Cons of nat x nats, introduces the 
type nats with signature functor Fnats-^ = nat x X and constructor Cons: nat x 
nats — > nats. Each element of nats corresponds to an infinite sequence of 
nat's. Given an /: nat — > nat, let ms ~ unfoldnats (Ax. case a; of (ny) ^ (/ Zero, 
SuccZero); {L2y) => (/ (Succy), Succ(Succj/)), so ms = the sequence /(O), /(I), 
/(2),--- . Given an ns: nats, let g = An.7ri(foldnat(Aa;. casea;of(tiy) ns; 
ii'2y) => (c^nats v)) n), SO g{n) = the nth nat in ns's sequence. 
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Del 



data T = ^^X.Ty^^ \ codata T = vX. Ty, 







(3) 



Destr'^ : 



(dr (Cr e))9iv'e' 



Unfold-,-: 



(F(unfold, f)){fe)e iv'e' 
d.r{unfo\d^fe)eiv'e' 



Fig. 3. Key Additions for S. 



As the above shows, codata are really higher-type objects. To help analyze 
this, define a rank-0 type is at type with no constituent codata types, and a 
rank-(fc + 1) type is a type with constituent codata types of maximum rank k. 
E.g., nat, tree, and nats are rank and a stream of nats is rank 1. Let Sk be 
the restriction of S to types of levels < 1 and ranks < k. Not surprisingly, the S^- 
functions of types nat x • ■ • x nat — > nat correspond to Peter's (fc + l)-primitive 
recursive functions |15| . We shall show how normal/safe ramification can rein in 
the power of these corecursions. First, we consider codata representations and 
their size. 

Representation and Size. A type-r codatum x is represented via lazy Ct- 
and/or u nfo I d,- -expressions; if we probe x with ever-longer series of destructor 
applications, a possibly infinite structure unfurls. A codatum is thus a function- 
like object that must be queried (via destructor applications) to be computed 
over. To measure codata-size we adapt Kapron and Cook's notion of the length 
of a type-1 function [T3]. Measuring just rank-0 codata suffices for this paper. 

Definition 6. Suppose eO is of type t , a rank-0 codata-type. 

(a) The apparent size of e0 (written: \e\0) is 1. 

(b) The observed size ofe0 (written: \\e\\9) is the function over natural num- 
bers: n I— >■ max({ |d(e)|0 1 d varies over sequences of compositions of destructors 
with (i) d{e) type correct and (ii) at most n occurrences of dr }). 

Roughly, (||e||0)(n) is the maximum apparent-size of the data in r-cons-cells 
along any path from the head of e6 that includes at most n type-r links. Example: 
For ns of Example[5l (||72s||0)(n) = l + maxi<„(the zth element of ns's sequence). 

The Ramified Case. RSi, our ramification of S, extends the normal/safe 
distinction to codata. Key Points: As the value of (unfold^ g) is the result of 
a (co)recursion, it should be safe, as g gives the computation step, we should 
have (7 : safe — > safe, and as unfold's are lazy, destructs drive the computation. 
Normal and Safe Types: First, we bring in all the RS]~ conventions to this 
setting to ramify data. Second, a declaration codata t = vt.a introduces the 
normal type r with constructor Cr and destructor dr as before, a safe type 
with constructor c^: (F^r)^ and destructor d^-T^ — >■ (F^r)^, and 

unfold^: (V normal (t)[(ct^ — > {Fr(j)^) r^] where unfold^ has the same 

operational semantics as unfoldr. Example: Replace unfoldnats, Zero, Succ, and 
/: nat — nat with unfold^^tg, Zero^, Succ^, and /: nat^ nat^ in Example's 
definition of ms, then ms can be assigned assigned type nats^. N.B. Given an 
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i?S'7-computable /: nat nat, there may not be an i?^^ -definable analogue of 
ms from Example [H 

Poly-Heap Size Bounds. To adapt poly-heap bounds to take account of ob- 
served sizes we use Kapron and Cook's notion of second-order polynomials ; 
these are roughly ordinary polynomials with applied type-1 function symbols 
included (e.g., -I- f{y + 2)). Now |e| < p + |sfv(e)| is a poly-heap bound on ap- 
parent size when p is a normal second-order polynomial (i.e., over { \x\ 1 r{x) is 
normal} and { ||a;|| | r{x) is a normal codata type }) and ||e|| < An.(p-|- |sfv(e)|) 
is a poly-heap bound on observed size where now p can have n as a type-0 variable. 

Theorem 7 {RS2 Poly-Heap Size-Boundness). For an RSi -judgment F h 
e: r where r and each a G image{F) is a ground type, one can effectively find 
a normal second-order polynomial p such that, if t is a data-type, then \e\ < 
p-\- |sfv(e)| and, if t is a codata-type, then ||e|| < \n.{p+ |sfv(e)|). 

RSi satisfies appropriate poly-cost boundness and poly- completeness proper- 
ties with proofs similar to the analogous (type-2) results in j8|9j : but, as with 
RSj , we have not the space to describe, much less prove, these results. 

Type Restricted RSi. Let RSi{a — > t\B) = the functions of type a ^ t 
computable by RS i-teims with types from Ty^ where B' = the normal and safe 
versions of the base types occurring in a, r, and B. For data bit — Nought [ One 
and codata stream = Consofbit x stream, one can show: (i) RSi{unit — >■ 
stream|'0) = cj-regular languages, (ii) i?S'i( stream stream|'0) — finite- 
state stream maps, (Hi) RSi ( unit ^> stream |" { nat }) — logspace streams, and 
(iv) RSj ( stream — > stream f { nat }) = logspace stream- functions. (In (pli)) and 
(|iv)) . nat plays the role of counter/pointer type as it does in the two-sorted 
characterizations considered in ^64.) 

4 Conclusions 

RSi characterizes a notion of poly-time computation over data and codata. As 
a formalism, RSj is not much more complicated than the original ones of Bel- 
lantoni and Cook [3| and Leivant [Tl] , although a few of RS2 's additions involve 
subtleties. The above work suggests many paths for exploration. Here, briefly, 
are a few. 

Pola vs. RSi . Pola restricts sharing for its notion of poly-time over data and 
codata. RSi essentially forces sharing to obtain its notion of poly-time over data 
and codata. How different are these two notions? Can one notion "simulate" the 
other in some reasonable sense? Is there a good notion of poly-time over data 
and codata that sits above both the Pola and RSi notions? 

Higher-types. Higher-type functions over data-realm and higher-rank streams 
and trees in the codata-realm are roughly two different perspectives on the same 
thing. In investigating true higher-type extensions of RSj , having these two 
views may help puzzling out sensible approaches to higher-type feasibility. 

Programming in RSi is clumsy. One problem is that iJS'j -recursions carry 
out their computations using safe — )■ safe functions, but there are very few of 
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these that have closed definitions in RSi. E.g., there is no closed -function 
that gives the nat^-maximum of two nat^-values, even though adding such a 
function would be a complexity-theoretic conservative extension. Based on an 
insight first pointed out and studied by Hofmann ;12 , any polynomial-time 
computable /:safe safe with |/(a;)| < |a;| for all x, would be a similarly 
conservative extension to RSi . Finding a simple scheme to add to RSi that 
allows the definition of more such functions over data (and the dual notion, 
< for functions over codata) is a nice problem. 
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E X \ {E1E2) \ {XX. E) I I {Ei,E2) \ {n^ E) \ {712 E) 

I (liE) I {L2E) I case£(,of(;,iXi) ^ £1; (12X2)^52 

Fig. A.l. L raw syntax, where X ::= identifiers. 

r,x:C\-e:T TheoiC^r TheiiC 

Id-I: ^-I: ^ ^-S; — ^- ^ ^ 

r,x:T\-x:T r h {Xx.e):C ^ r ri-(eoei):r 

. , Fhei.ai rhe2:cr2 ^ Th e: cri X a2 , , ^ 

unit-// X-// ^ x-Ei: ^ (t) 

rh():unit rh (61,62): cri X cr2 rh(n,e):ai 

r\-e:ai F h Cq: ai + a2 { E, Xi: ai h ef. T}i^i^2 

+-^'- TTT—, ^ (t) 



r h (ti e): CTi + a2 E \- (case 60 of (ti x\) =J> ei; (t2 X2) 62) 



Fig. A. 2. L typing rules, (f) i = 1, 2. 

Val: fv9\s&\ ^ ^q,. 

vOivO V value / xO ivO' ^ ^ ' ' 

X-A-pp: ; 

(60 61)^ \. v6 

jri n . • ( T ) ( fl Q P ' I T 1 

{Lie)9 i{L^v)9' (case6o of(ti xi) ei; {i2 X2) ^ 62)6 1 v9' 

ei9ivi0i €'26^1 V292 ^ e9i{vi,v2)9' 
Unit: — — Pair: — ^ ^ (t) Proji: = — = — =-r (t) 

09109 {ei,e2)9i{vi,V2)92 i7Vie)9iv,9' ^'^ 



Fig. A. 3. L evaluation rules, (f) i = 1, 2. (if) 62 =a 62, but 62 avoids clashes with 9i. 



Technical Appendix 
Notes 

1. The "S" in and 5 stands for structure and the "R" in RSy and RSj 
stands for ramified. 

2. Internal representations of constructors are underlined as in Figs. [T] and I A. 31 

3. The side- condition of Pair-rule in Fig. \A.l^ If ei04,wi0i and 62^4, U2^2, then 
9i and 62 may be inconsistent. Hence in Pair, 62 is alpha-reduced to e'2 so 
that the ei- and e2-evaluations introduce distinct variables into their value's 
environments. 

4. The unsugared version of Succ(Succ Zero) is Cnat(t2(cnat(''2(cnat('-i())))))- 

5. Call-by-value and growth. Note that for e' of ground- type, |((Aa;. Forka:x) e')| 
— 1 + |e'| because, by the call-by- value semantics, e' is evaluated to a value 
v9 (i.e., a reference to a data- representation) which becomes the value of x 
used in Forka:a;. This is explicit in our closure-based evaluation semantics, 
since this expression evaluates to Fork(a;, a;)[a; v9]. 
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6. Dodging exponential growth. If one could define a function /: nat — tree 
such that /Zero = Leaf and /(Succx) = Fork (/ x) (/ x), then \fx\ could 
be exponentially larger than Theorem [4] implies that no such / is RSi- 
definable, but intuitively the reason is that a fold„at definition provides one 
reference to the result of the recursive call since the Succ-constructor is 
unary. This one reference can be used multiple times, but always representing 
links to the same result, and hence not increasing the size. The function 
that is iJ^j -definable is (in effect) f Zero = Leaf and /'(Succ.t) = letr = 
f'{x) in Fork(r, r). 

7. Bellantoni and Cook's Raising Rule. It amounts to a (sound!) specialization 
of Whitehead and Russell's Axiom of Reducibility. Compare the end of the 
first paragraph of l3l §5] and *12.1 of Principia Mathematica, Vol. 1, 1/e, 
Cambridge University Press, 1910, available from http : //name . umdl . umich . 
edu/AAT3201. 0001. 001. 

8. Consider Zeawes: tree ^> nat where leaves{t) — the number of leaves of t. 
RSi cannot compute this because \leaves(t)\ can exponentially-larger than 
\t\. In contrast, Pola can compute this as Pola allows some forms of change- 
of-parameter in recursions and, under Pola, t is always a strict tree. 

9. Codata, Memoization, and Sharing. Corecursions (unfolds) are not memoized, 
but structure sharing is allowed in codata. 

10. Codata and poly-completeness. Since type-level 1 RSj functions can have 
codata inputs and outputs, we can translate some standard examples from 
type-2 complexity to show that RSi is missing some functions over codata, 
where these functions' runtime complexity is comparable to that of RSi- 
computable functions. The cure to this problem is to introduce an analogue 
of Bellantoni's Mod function [5J Chapter 8] (Modmn — m mod n) or the 
authors' Down function jB] §4] (Downxy = x, if |a;| < \y\; e, otherwise) both 
of which are (safe — J> normal normal) functions. As to the motivations for 
such functions and their odd typing we refer the reader to [F. Adding such 
a function to RSi is not a major change. 

The next lemma is a key property of terms with normal types. Its proof is a 
simple induction on type derivations. 

Lemma A.l. If F \- e:T where r is normal, then sfv(e) — 0. 

Lemma A. 2 (Basic Poly-Heap Bounds Arithmetic). Suppose F \- e:a, 
|e| < p + |sfv(e)|, F h e':a', and \e'\ < p' + |sfv(e')|, where p and p' are 
polynomials over { |a;| 1 F{x) is normal}. Also suppose x G fv(e) with F{x) = a' . 
Then: 

(a) \e[x : — e'] \ < {p[\x\ : = p']) + |sfv(e[x := e'])\, if a' is normal, 
(h) \e[x : ^ e'] \ < p + p' ~\- |sfv(e[a; : = e'])|, if a' is safe, 
(c) |(e,e')l <P + p' + |sfv((e,e'))|. 

Proof (Sketch). Part (gj); By sfv(e') = 0. Hence, by the monotonicity of our 
polynomials, (a) follows. 

Part (jb]); By monotonicity again (and some abuse of notation): |e[x : = e']| < 
p-f |e',(sfv(e)-{x})| <p-F(p'-F|sfv(e'),(sfv(e)-{x})|) < p+p' + \e[x := e'\\. 
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Part (jcj); A naive upper bound on |(e, e')| is p + p' + 2|sfv( (e, e') )|, but this 
double counts the structure shared by e and e'. So by ehminating the double 
counting, we have the required bound. □ 

Poly-Heap vs. Poly-Max Bounds. The analogue of parts (jaj) and (|b]) of Lemma 
I A. 2 1 hold for poly-max bounds. Bounds of the form of part (|bj are key in poly- 
boundedness arguments for forms of "safe" recursions. The analogue of Lemma 
IA.2tj cj) fails for poly-max bounds. However, if one requires {a la Pola) that e 
and e' have no safe variables in common, then the poly-max-analogue of Lemma 
IA.2t|cj) does hold. These two alternative ways of counting are at the heart of the 
RSi /Pola split. Note that what is a stake in how one bounds a pair is how, in 
general, one bounds the size of branching structures. 

Theorem A. 3 (Theorem [4] Restated). Given an RS^ judgment F h e:T 
in which r and each a G image(/^) is a ground type, one can effectively find a 
normal polynomial p with \e\ < p + |sfv(e)|. 

Proof (Partial sketch). Our first problem in exhibiting the upper bound is that 
e may well contain higher-type subterms. Let e be the normalized version of e. 
Note that |e| < |e|, where |e| can be much larger than |e|. But a poly-heap bound 
on |e| serves as a bound on |e|. Thus, we assume without loss of generality that 
e is normalized. Since e is normalized, the only place a A-expression can occur 
in e is as the first argument of a fold^-construct, moreover, these A-expressions 
have level-1 types. Also note that each variable occurring in e must be of ground 
type. 

The proof is a structural induction on the derivation of _r h e: r. We consider 
the last rule used in this derivation. 

All of the cases, save one, are standard, straightforward arguments — adjusting 
for the change from poly-max to poly-heap bounds. So we omit these. The in- 
teresting case is the one for fold^. We treat this case which, for simplicity and 
concreteness, we further narrow to the case for foldtreei which touchs on the key 
issues in the general fold^-case. Recall that FtreeX = unit -\- X x X, i^tree/ = 
idumt + /x/ = Au.(caseuof (tiw) =^ (t2 '-2(/(7ri (?;)), /(7r2(u)))) , and 

(foldtree 9) ° Ctree = 5 ° -F'tree (fold^ree ff)- 

Some conventions: To cut down on clutter, when y is of ground type a and v 
is a type-a value (i.e., a pointer to an internal representation of a type-cr object), 
we shall rewrite e9[y i— >■ v9'] to e[y : = v]9, provided the value named by v9' is 
a function of 9. The substitution of the (pointer) v for the variable y in e is, in 
essence, just cutting out one level of indirection and thus simplifies reasoning 
about the value of e9[y i-)- v9']. Similarly, in "heap" expressions \ei, . . . ,ek\ we 
allow value terms (i.e., pointers to representations) among the e^'s with the obvi- 
ous meaning of |ei, . . . , efc|, again we are simply cutting out a level of indirection. 
Finally, if E a, set of fc-many expressions ei, . . . , e^, then \E\ = |ei, . . . , ej.|. 

Case: foldtree"^- Thus, e = (foldtree (Az.eo) ei), where T h e: t, F, z: Ftr^^T h 
Bo'-T, F \- ei: tree, and r is a safe base type. By the induction hypothesis, there 
are normal polynomials po and pi that |eo| < po + lsfv(eo)|, and |ei| < pi. Fix 
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an environment 6 and suppose eiO ],ti9'. Recall that ti is a pointer to the dag- 
representation of ei's value. (Since ti is a data-constant, it suffices to take 9' = 
9.) Let t2, - ■ ■ ,tn be pointers to the other tree-cons-cells in the representation, 
ordered so that, for all i and j, if U is an dag-ancestor of tj, then i < j. Suppose, 
for i = l,...,n, {fo\dl^^^{Xx.eo)ti)9 -I ri9i, where is a pointer to the dag- 
representation of the result of the fold^ree"''6Cursion. N.B. The ti's and r^'s are 
functions of 0. So, as a reminder of this, in our bounds calculations, we shall 
make explicit the usually suppressed 9. 

Claim 1: Suppose the hypotheses of Lemma [A. 2 1 and suppose a' is safe. Then 
|{e[x := e'],ei,...,efc}16' < (p |{ e', ei, . . . , } U sfv(e[a; : = e'])|)6l, for ah 9. 

Proof: This is just an extension of the proof of Lemma lA.2r b). 

Claim 2: For each z = 1, . . . , n: 

(a) If = Leaf = C(.rgg(ti ()), then (foldtree(-^2;.eo) tj)6' = eo6'[z ()]. 

(b) If ti = Fork tj tj = CtreeU2 fei^fe)); thcu {fo\dl^^^{Xx . bq) ti)9 = eo9[z 
(-2 ii^j,i~k)] where j, k > i. 

~(c) |{r,,...,r„}Usfv(e)|6l <po + |{r^+i,.-.,r„}Usfv(e)|6l. 

Proof: Part (a) is a straightforward calculation. 

Part (b) is another straightforward calculation, taking into account that the 
implementation of fold^^gg is memoizing. 

Part (c). Case: ti is a leaf. Then 

|{r„...,r„}Usfv(e)|6l 

= \{eo[z : = i:iO],r,,+i,...,r„}Usfv(e)|6' (by part (a)) 

= Po + \{LiO,ri+i,. . . ,r„ } U sfv(e)|6l (by Claim 1) 

= Po + \{n+i, . . . ,r„ } U sfv(e)|6' (since jt^ Q] = 0). 

Case: ti is a fork. Then 

|{r„...,r„}Usfv(e)|0 

= \{eo[z := i2(rj,rfc)],ri+i,...,r„}Usfv(e)|6l (by part (b)) 

= Po + |{ A2 (^j:''fe), ri+i, . . . , r„ } U sfv(e)|6l (by Claim 1) 

= Po + \{ri+i, . . . ,r„ } U sfv(e)|6' (since j, k > i). 

Thus by Claim 2(c), |(foldtree(Aa;.eo) 61)6*1 = |(foldtree(-^2;.eo) ti)0| = |{ri}U 
sfv(e)|6' < |{ri, . . . ,r„} U sfv(e)|6' < {po ■ n + |sfv(e)|)6'. RecaU that |ei| < pi. 
Therefore, p ~ pa ■ pi suffices for this case. 

The effectiveness part of the theorem follows from the fact that the induction 
argument essentially describes a recursive algorithm for constructing p. □ 

Theorem A. 4 (Theorem [7] Restated). For an RSi -judgment h e: r where 
T and each a € image(r') is a ground type, one can effectively find a normal 
second- order polynomial p such that, if t is a data-type, then |e| < p -\- |sfv(e)| 
and, if T is a codata-type, then \\e\\ < An.(p+ |sfv(e)|). 
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Proof (Partial sketch). As in the proof of Theoreni|4j we may without loss of gen- 
erality assume that e is normalized. Thus the only place a A-expression can occur 

c c 

in e is as the first argument of a fold - or an unfold -construct, and moreover, 
these A-expressions have level-1 types. Also note that each variable occurring in 
e must be of ground type. Our proof is a structural induction on the derivation 
of -T h e: T. We consider the last rule used in this derivation. 

Now, as in our sketch of the proof of TheoremlH here we shall present just one 
key case (unfold^-/), and in fact, a specialization of that (unfold^jj,^g-/). Unlike 
the situation for the proof of Theorem^ the omitted cases here are less standard 
and a few involve some fine points. However, almost all of these omitted cases 
parallel problems we dealt with our work on feasible type-level 2 programming 
formalisms I8'9J. 

Case: unfold^ats"-'^- We consider the case where cr is a data type. Thus, e = 
(unfold^jj(.g (Az.eo) ei), where cr is a safe ground data-type, P, z: h eo: nat^ x 
(T^, and Ph ei.a^. RccaU i^„ats-'^ = natxX, F„ats/ = idnatx/ = Au. (ttiu, /(7r2u)), 

andd„atso(unfoldnats 9) = -Fiiatslunfold^ats = AM.(7ri(g(u)), unfold^ats 5 (7^2(3 (■"))))■ 
Let gi — 1^1 o g and g2 — '^2 ° g, then for all n > 1: 

4ats(unfold^ats 5") = (ffi (52"" ^^") > upfoldLts 5 (.92"''^^)) ■ (4) 

Now, by the induction hypothesis, there are normal polynomials po ^md pi such 
that |eo| < Po + |2,sfv(e)| and jeil < pi -I- |sfv(e)|. By ([4]), to bound ||e||(n) for 
n > 1, it suffices to bound \gi{g2~^^2)\ for gi = 7rio(Az.eo) and g2 — 7r2o(Az.eo). 
For n = 1, \gi{g2~^ei)\ = |eo[z : = 62]! < _po + |ei,sfv(e)| < PQ+pi^\e\. Iterating 
this, we have for n > 1, ||e||(n) < \gi{g2~'^ < Pq + Pi ■ n + |sfv(e)|. Hence, 
p = Pi) + Pi ■ n suffices. 

In the case where cr is a codata type, the basic structure of the argument stays 
the same but the (second-order polynomial) algebra becomes more involved. 

The induction above essentially describes a recursive algorithm for construct- 
ing p. Hence, the effectiveness part of the theorem follows. □ 



